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ABSTRACT 



Discrete orthogonal functions are used in adaptive system 
identification algorithms. Adaptive filters are realized by 
forming linear combinations of discrete Legendre, Laguerre, 
and Jacobi polynomials, and backward prediction-error 



polynomials 


from a 


lattice 


structure . 


The adaptive filter 


weights are 


updated 


using 


the LMS 


algorithm. 


FIR and 


HR 


bandpass filters are 


modeled using 


the 


adaptive 


filters , 


and 


performance 


comparisons are 


made . 
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I. 



INTRODUCTION 



A. ADAPTIVE SYSTEM IDENTIFICATION ALGORITHMS 

Adaptive FIR and HR digital filters are widely used in 
system identification algorithms. The extensive use of HR 
adaptive filters has been hindered by several problems: 
(1) Instabilities encountered in their design; (2) Local 
minimums in the mean square error surface; and (3) Slow 
convergence rates of the adaptive filter weights [Ref. 1]. 
Although FIR adaptive filters do not suffer from the problems 
that ail HR adaptive filters, they typically require much 
larger orders to effectively model a given system. 

Using orthogonal functions in system identification 
algorithms was first employed by Lee in 1932 [Ref. 2]. 
Adaptive filters based on orthogonal functions have several 
advantages, namely, they are always stable and have an 
infinite impulse response, making their use ideal for modeling 
systems with long impulse responses. Additionally, the FIR 
adaptive filter weights converge faster than those associated 
with an HR filter structure due to the unimodal mean square 
error surface. The filter is realized by forming linear 
combinations of discrete orthogonal functions, which are 
weighted to minimize the mean square error of the 
approximation . 
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B. THESIS OUTLINE 



A brief description of contents of the remaining chapters 
’follows. Chapter II introduces the theory of orthogonal 
functions and their use in modeling linear systems. The 
definitions of the orthogonal functions included in this 
research are given. Chapter III develops the actual adaptive 
filter model that utilizes the orthogonal functions for system 
identification. The derivation of the filter weights is 
discussed in detail; significant development of the discrete 
orthogonal functions is shown. Chapter IV presents the 
simulation results of the various filters developed in chapter 
III and comparisons are made between Legendre, Laguerre, 
Jacobi, and backward prediction-error adaptive digital 
filters. Chapter V presents conclusions including limitations 
of the orthogonal polynomial filters and recommendations for 
further research. 
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II. ORTHOGONAL FUNCTIONS 



A. THEORY OF ORTHOGONAL FUNCTIONS 

Let {w^(r), W 2 (r), ♦♦♦} denote a set of real and continuous 
functions. Then the system of functions is said to be 
orthogonal in the range (a,b) if 

r .V f 0 for m * n . 

j dX. (1) 

a ^ 

where is called the norm of the corresponding function 
[Ref. 3]. The orthogonal set {Wj^(r)} is considered complete 
if either of the following conditions is true [Ref. 2]: 

(1) There exists no function x(r) with 

b 

j {x) dx < <x> (2) 

a 

such that 

b 

j x{x) w^(x) dx = 0 , J2 = 0, 1,2, ... . ( 3 ) 

a 

(2) For any piecewise continuous function h(r) with 

b 

f hUr) dx < 00 ( 4 ) 

a 

and an £ > 0, there exists an integer N and a polynomial 
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( 5 ) 



N 



E 

n=0 






such that 

^ N 

f I h(x) - 1^ dT < e . (6) 

i «=o 

Any stable causal system, h(T), satisfies (4) in the 
interval [0, oo) and can be represented by a complete set of 
orthogonal functions [Ref. 2]. Letting {Wj^(t)} represent a 
complete set of orthogonal functions in the interval [0,°o), 
then 



h(x) 



j 52 0 ^ X ^ oo 

n=0 

^ 0 else , 



(7) 



where the c^ represent the expansion coefficients. 

Albeit impossible to form an infinite sum of orthogonal 
functions, it is practical to form a finite sum of orthogonal 
functions with an accompanying error, e, as given by (6). It 
is therefore possible to form an approximate synthesis of a 
linear system, h(r) , by forming finite linear combinations of 
orthogonal functions: 



J^(x) = J E for 0 ^ X ^00 (g) 

n=0 

[O else . 

This, in itself, is not particularly significant, for 
there are other families of functions that are not orthogonal 
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that satisfy (8). A Taylor series expansion, for instance, is 
never orthogonal on any interval, but it is often effective 
when approximating functions [Ref. 3], Orthogonal functions, 
however, have several desirable characteristics that make 
their use uniquely advantageous when synthesizing linear 
systems . 

Whereas (8) is based on a continuous set of orthogonal 
functions, it is also possible to form an approximate 
synthesis of a discrete linear system, fi(k), such that 

N 

liik) = c^w^ik) , k = 0 , 1, 2, , (9) 

n=0 

where {w^(k)} represents a complete set of discrete orthogonal 
functions, and the expansion coefficients, c^^, are chosen to 
minimize the mean square value of the approximation error. 

B. CLASSICAL ORTHOGONAL POLYNOMIALS 

The classical orthogonal polynomials form a subset of 
orthogonal functions. The three classical orthogonal 
polynomial families that are included in this research are the 
Jacobi, Legendre, and Laguerre. Other families such as the 
Chebyshev and Hermite were found to be unsuitable for linear 
system synthesis using the methods described herein. 

The Legendre polynomials, denoted by Pn("c) [Ref. 4], are 
orthogonal on the interval [-1,1], and, in the form of (1), 
their norm is given by 
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f I p„(t) 1^ dx = ^ g-- . (10) 

J " ' 223 + 1 

-1 

The Jacobi polynomials, denoted by [Ref. 4], are also 

orthogonal on the interval [-1,1] and their norm is given by 



1 



f (1 - T)“(l + T)P I (t) |2 dx 



( 11 ) 



^ r(/3+g+i) r(23+p+i) 

(2n+a + P+l) n\ r( 23 +a + P+l) 

Note that if a substitution is made into (11) with both a = 0 
and 3=0, the result is equivalent to (10). Therefore, the 
Legendre polynomials form a subset of the Jacobi polynomials. 
Given the orthogonality interval of the Legendre and Jacobi 
polynomials, [-1,1], it is not possible to make a direct 
substitution of the polynomials into (7). The desired 
orthogonality interval for synthesizing causal linear systems 
is [0,oo); thus, the orthogonality interval of the Jacobi and 
Legendre polynomials must be shifted by means of a change of 
variables. Details of this process are discussed in 
chapter III. 

The Laguerre polynomials, In('c) [Ref. 2], are orthogonal 
in the interval [0,°o), making them more readily applied to the 
synthesis of linear systems than Jacobi and Legendre 
polynomials. Their norm is given by 
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/ I i.<^) 



2 dT = 1 



( 12 ) 



0 



C. ORTHOGONALITY OF THE LATTICE PREDICTOR 

Assuming a stationary input of random variables, each 
stage of the lattice predictor is known to produce a sequence 
of uncorrelated random variables in the form of the backward 
prediction errors, {bQ(k), b<,(k), •••} [Ref. 3]. These 
backward errors are orthogonal in the range [0,<») and, 
therefore, well suited for synthesizing discrete linear 
systems of the form 



The lattice filter structure is a manifestation of the 
Gram-Schmidt orthogonalization procedure insofar as the 
generation of the backward errors is concerned. The forward 
prediction errors associated with prediction-error filters are 
also produced by each stage of the lattice filter. However, 
their application to linear system synthesis is not germane, 
for the forward errors are correlated and, therefore, not 
orthogonal [Ref. 3]. 



hik) 



for 0 ^ k < <» 



(13) 



0 



else . 
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III. SYSTEM IDENTIFICATION AND MODELING 



A. ORTHOGONAL ADAPTIVE FILTER MODEL 

Consider a system where x(k) denotes an input to both a 
causal linear system, h(k), and an adaptive filter model, h(k) 
as shown in Figure 3.1. Let d(k) be the desired output of the 
system and y(k) be the output of the adaptive filter. 




Figure 3.1: System identification configuration 

Following the derivation in [Ref. 1], the output error is 
given by 
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( 14 ) 



eik) = dik) - yik) 

k 



= dik) - x(i) liik - i) 



J =-00 



From (9), we write 

k N 

eik) = dik) - xii) - i) . (^5) 

i=-oo n=0 

where {w^(k)} represents a complete set of discrete orthogonal 
functions, and the c^ are the expansion coefficients. 
Rearranging the summations in (15) yields 

N k 

eik) = dik) - xii) w^ik - i) . (16) 

n=0 i = -oo 

And therefore, 

N 

eik) = dik) - c^u^ik) = dik) -c^uik) , (17) 

n=0 



where 



C = [Cp, c^, C;^] ^ , (18) 

uik) = [Uf^ik) , u^ik) , Uj^ik)]^ , (19) 

and 

k 

2 = -00 

Figure 3.2 depicts the generic orthogonal function model. 
We consider each 0^(2) to be a black box that has two outputs 
when excited by an impulse: One is an orthogonal function 
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u^(k), and the other is a connection to the next black box. 
For the purposes of this thesis, we limit our investigation to 
Legendre, Jacobi, Laguerre, and backward prediction-error 
functions to model systems. 




Figure 3.2: Generic adaptive filter configuration for 
orthogonal functions. 

We wish to find a set of expansion coefficients to 
minimize the mean square error of (17). Using the LMS 
algorithm, we take e^(k) to be an estimate of the 
instantaneous mean square error [Ref. 6]. To obtain the 
minimum mean square error, we find the corresponding gradient 
estimate by taking the derivatives of e^(k) with respect to 
the expansion coefficients: 
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V(ic) 



( 21 ) 



= = 2e(*)i^ = -2e(k)u(k) 

dc oc 

Applying the method of steepest descent, the LMS algorithm 
updates the expansion coefficients using 

c{k+l) = c(k) + |i(-V) , (22) 

where p is a constant that regulates the convergence rate. 
Substituting (21) into (22), we obtain the LMS algorithm; 

c{k+l) = c{k) + 2\ie{k) u{k) . (23) 

The expansion coefficients of vector c converge in the 
mean when [Ref. 6] 

0 < ^ I i. 1 ^ • (24) 

|u(ic) p 

All simulations in this thesis set p according to the 
range specified in (24). The expansion coefficients are 
updated after each iteration in accordance with (23). 
Convergence rates for the expansion coefficients vary 
depending on model type and order. 

A. LEGENDRE POLYNOMIALS 

Recall from chapter II that continuous Legendre 
polynomials form a complete set of orthogonal functions in the 
range [-1,1] and are defined as 
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< 



for m = n 
for m ^ n . 



( 25 ) 



1 



2 






2/3 + 1 
0 



Following the derivation given by Lee [Ref. 2], a change 
of variable is made to transform the orthogonality range for 
the Legendre polynomials from [-1,1] to [0,oo)^ which is the 
desired range to correspond to the causal time axis. Letting 
the first change of variable be 



T = 2y - 1 



( 26 ) 



causes (25) to become 




for m = n 
for m * n . 



Letting the second change of variable in (27) be 



y = e 



-Ct 



( 28 ) 



where C is any positive real constant, yields 



J Ce~'^^p^[2Ce~^^ - l)p^{2e~^^ - 1) dt 



0 




( 29 ) 



0 for m * n 



Now, defining 



v^(t) = yc p^(2e'^‘' - 1) 

and substituting into (29) gives 



( 30 ) 



12 



oo 



for m = n 
for m * n . 



( 31 ) 





Since (31) satisfies the definition of orthogonality given by 
(1), then the set {Vj^(t)}, a shifted version of the Legendre 
polynomials, is an orthogonal set defined in the desired range 
From (7), h(r) can now be represented by the series 

given by 



E for 0 ^ X ^ 00 ^ 32 ) 

n=0 

0 else , 



where, again, c^ are the expansion coefficients chosen to 
minimize the mean square error, and {v^(t)} is the orthogonal 
polynomial set based on the shifted Legendre polynomials. 

In order to realize a digital network, it is necessary to 
generate the shifted discrete Legendre polynomials based on 
the continuous set {v^(t)}. It is convenient to note the 
first few terms of the Legendre polynomials [Ref. 7], {Pr,(‘c)}: 



Po(^) = 1 

Pi(t) = X 




(33) 



Substituting (33) into (30), the first few terms of {v^(t)} 
are 



Vq ( t) = ^ 

v^it) = y/Ci-1 + 2e'^^) ^ (34) 

V 2 ( t) = y/C(l - Se'^'^ + 6e~^^^) t ^ 
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Taking the Laplace transform of (34) generates the first few 
terras of the shifted Legendre polynomials in the frequency 
’ domain, which are given by 



V^{s) 

^2(5) 



= v/C - 

= v/3C 
= v/5C 



1 



is + c/2) 

is - C/2) 

is + C/2) is + 3 C/2) 
is - C/2) is - 3 C/2) 



is + c/2) is + 3C/2) is + 5C/2) 



( 35 ) 



From (35), it is apparent that the general expression for 
{V,(s)} is 



v;,(s) = 



is - c/2) is - 3C/2) - (s - j2n - 1) C/2) 
is + C/2) is + 3C/2) -(s + i2n + 1) C/2) 



( 36 ) 



for n=0, 1, 2, ..., where 



= v/(2j3 + DC . (37) 

Of the several techniques available for performing an 
analog to digital filter transformation, the matched Z- 
transforra is best suited for our purposes. This technique 
preserves the ability to express the digital frequency terras, 
{V^(z)}, in a closed form as in (36) and, more importantly, 
allows for a filter structure that is easily synthesized. The 
matched Z-transforra maps the poles and zeros of {V^(s)} into 
those of {V^(z)} through the substitution 

(s + a) (1 - z'^) , (38) 

where T represents the sampling period of the discrete-time 
filter [ Ref . 8 3 . 
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Accordingly, performing an analog to digital 

transformation on (36) yields the first three terms of 

{V„(z) } : 



Voiz) 

V^iZ) 

V^iz) 



4C 

1 - 

yjC (1 - 

(1 - (1 - 
ysc (1 - (1 - 

(l-e'*^/^z'^) (l-e'^*^^^z'^) 



(39) 



As noted, the matched Z-transform preserves the ability to 
express the terms of {V^(z)} in the closed form 

^ (1 - (1 - ( 40 ) 

^ - (1 _ (1 - ' 



for n=0, 1, 2, ..., where 

A„ = V(2j2 + 1)C . (41) 

The synthesis of a discrete system using shifted Legendre 
polynomials is accomplished by generating each Legendre 
polynomial using its corresponding transfer function in (40). 
Accordingly, substituting each Q„(2) shown in Figure 3.3 into 
the filter structure shown in Figure 3.2 provides the 
necessary filter structure to generate each polynomial. 



C. JACOBI POLYNOMIALS 

The Legendre polynomials form a subset of the much larger 
class of Jacobi polynomials. Like the Legendre polynomials, 
the Jacobi polynomials form a complete set of orthogonal 
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Q,(z) 




Figure 3.3: Module of Legendre polynomial adaptive filter. 

functions in the range [-1,1] and, therefore, require a 
transformation to shift the orthogonality range to [0,<»). 

The Jacobi polynomials, ( "c) } / are defined as 




x)“(l + x)P (x) dx 



kn for m = n (^2) 
0 for m ^ n , 



where 



j;.2 ^ r(rz+a^3+l) r(72+(3+l) 

^ (2i2+a + P+l) 72! r(72+a + P+l) 

Letting the first change of variable be 



(43) 



causes (42) to become 



X = 2y -1 



(44) 
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2 



/ 



(2 



2y) “(2y) P (2y - 1) (2y - 1) 




if m =■ n 
if m * n 



dy 

( 45 ) 



Letting the second change of variable in (45) be 

y = , 

where C is any positive real constant, yields 



( 46 ) 



2 f Ce-^U2 - 2e-‘^^)«(2e-^^)P - 

0 



X p 



(a,P) 

n 



( 2 e 



1) dt 



I for m = n 
\ 0 for m * n 



1 ) 



( 47 ) 



Now, defining 



= v /^ 2 P /2 (2 



g-c(p.i)t/2 pU.P) (2e-ct 



1 ) 



( 48 ) 



and substituting into (47) gives 



f vj*-'” (t) (t) dt - 

0 



for m = n 
0 for m * n , 



( 49 ) 



where is defined as in (43). Since (49) satisfies the 

definition of orthogonality given in (1), the shifted Jacobi 
polynomials, {v^^“'^^(t) } , form an orthogonal set of polynomials 
in the range [0,<»). From (7) , any causal system, h(t), may 
be represented by 
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hit) 



n=0 

0 



for 0 ^ t ^ w 
else . 



(50) 



In order to synthesize discrete linear systems, it is 
necessary to generate the shifted discrete Jacobi polynomials. 
Let the derivation of the shifted discrete Jacobi polynomials 
begin by listing the first few terms of the continuous Jacobi 
polynomials : 

( t) = 1 

=(a+l) + ^ (a + p+2) (t-1) 

p (a+l) (a+2) + — (a + p+3) (a+2) ( t-1) 

2 2 

+ — (a+P+3) (a+P+4) (t-1)^) 

8 

Substituting (51) into (48) yields the first few terras of 

{v/“''^^t) } : 

vJ“'P^(t) = v^2P/2 (2 - 

Vi^“'^^t) = v^2P/2 ^-c(p.i)t/2 (2 - 2e-^")“/2 

x[(a.l) .|(a.p.2)(2--2)] 

V2'“'P^(t) = /^2P/2 (2 - 2e-^‘^)“/2 

X [(A(a+l) (a+2) 

2 

+ (tt + P+ 3) ((tt+2) (2e “ 2) 

2 

+ A (a + p+3) (a + p+4) (2e-‘^‘^ -2)2] . 

8 

We desire to obtain { { s ) } , the frequency domain terms 
of the shifted Jacobi polynomials; however, it is not possible 
to form a general expression for each term of { ( s ) } 
because the Laplace transform of (52) yields entirely 
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different results depending on the value of a. Therefore, 
without losing the generality, we make the derivation specific 
to a = 2.0 for the remainder of this development. 

Substituting a = 2.0 into (52) and taking its Laplace 
transform, we obtain the first few terms of { ( s ) } : 



is) 

is) 

is) 



^0 

^ C(P.I) ) , C (. P^3) ,) 

2 2 

is - (C+D/6) 

^ C(P.I) ) , C(p.3) ,) ^ Ci^^S) ) 

2 2 2 

iq [12s^ - (4P-8)Cs - (p2+6p+5)C2] 

(s. ) (s. ) (s-H ' 

2 2 2 2 

( 53 ) 



where the K are constants. 

n 

Unlike the Legendre polynomials, there is no apparent 
closed form expression to represent the terms of { ( s ) } . 
The denominator terms can be put into a closed form 
expression, but not the numerator terms. This is an important 
concern, for it is carried over to the frequency terms of the 
discrete shifted Jacobi polynomials, { ( z ) } . 

Using the matched Z-transform method to perform an 
analog to digital transformation on the first two terms in 
(53) produces the first two terms of { ( z ) } : 



where 



iz) 

iz) 



^00 

(1 - 5oZ‘^) (1 - a^z~^) 

JCii (1 - 

(1 - aoZ"^) (1 - a^z'^) (1 - a^z'^) 



( 54 ) 
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a 



e 



2 



( 55 ) 



n 



and the are constants. 

nn 

without a closed form representation of the terms in (54), 
the problem of generating the discrete Jacobi polynomials is 
considerably more demanding than that of the Legendre 
polynomials. Whereas the transfer function needed to generate 
each of the shifted Legendre polynomials is known (see (40)), 
the transfer function needed to generate each of the shifted 
Jacobi polynomials must be explicitly derived. Due to the 
complexity of the expressions involved , it was necessary to 
use a symbolic software program called MACSYMA to generate 
both the terms of {v^^^'*^^(t) } and { ( s ) } . The terms of 
{ ( z ) } could then be found by transformation. 
Unfortunately, only the first 15 terms of ( z ) } were 

derived with a = 2.0 and a = 4.0 due to the large size of the 
expressions involved. 

D . LAGUERRE POLYNOMIALS 

The Laguerre polynomials, {l^(t)}, form a complete set of 
orthogonal functions in the range [0,o°) and are defined by 



Laguerre polynomials are defined over the desired 
orthogonality range, [0,co); thus, we can immediately proceed 




1 for m = n 
0 for m * n . 



( 56 ) 



0 
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with the derivation of the discrete Laguerre polynomials that 
are needed to synthesize discrete linear systems. The first 
few terms of {l^(t)} are: 



io(t) = ^/2C 

l^it) = -/2C (2Ct - 1) (57) 

l^it) = -/2C(2C2t2 - 4Ct + 1) , 

where C is any positive real constant. Taking the Laplace 
transform of (57), we have 



Lq{s) 

L^(s) 

L^is) 



4tx: 



1 

(s + C) 

(s - c) 

(s + C)2 

( s - c) ^ 

( s + C) ^ 



(58) 



Using the matched Z-transform technique to perform an analog 
to digital transformation on (58) yields 



Lq (z) 
Lj (z) 
L^(z) 



= .J2C 
= yf2C 

= 42c 



1 

(1 - e'^z'l) 
(1 - e^z~^) 

(1 - 

(1 - e ^z ~^ ) ^ 
(1 - ^ 



(59) 



The closed form general expression for the terms in (59) is 

t„(2) = ^ . (60) 

Notice that all zeros of (59) are located at z=e^ , and all 
poles are located at z=e”^. The synthesis of any linear system 
using Laguerre polynomials is accomplished by generating each 
Laguerre polynomial using its corresponding transfer function 
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given in (60). Accordingly, substituting each Qn(z) in Figure 
3.4 into the structure shown in Figure 3.2 provides the 
necessary filter structure to generate the polynomials. 




/ 



\ 



1 - 
1 - 



1 




Figure 3.4: Module of Laguerre polynomial adaptive filter. 

E. LATTICE PREDICTOR 

Let {bQ(k), b^(k), bj^(k)} denote the first N+1 

backward prediction errors associated with a backward 
prediction error-filter. If x(k) is a stationary input of 
random variables to a backward prediction-error filter, it can 
be shown that the backward errors are orthogonal, that is, 



where E[] is the expectation operator. Following the proof 
given by Haykin [Ref. 5], we write 




for m = n 
for m * n 



( 61 ) 
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( 62 ) 



~ X{k - 1) , 

J=0 

where ajj|(l), 1 = 0, 1, . . . , m, are the coefficients of a 

prediction-error filter of order m. Substituting (62) into 
(61) yields 



E[bj„{k) b^ik)] 



= E 



m n 



a^{m - J) a„{n - p) x{k - 1) x{k - p) 



1=0 p=o 
m n 



= ^ ^ - D^n^n - p) E{x{k - 1) x{k - p)] 



i=0 P=0 

m n 



= E E - P)^x^P - -Z) ' 

J=0 p=0 



( 63 ) 



where r^(p-l) denotes the correlation function. The normal 
equations for a backward prediction-error filter are given by 
[Ref. 5] 



n 



E 



a^ in - p) r^ip 



1 ) 



kn for 1 = n 
0 for 1 * n 



Substituting (64) into (65), we find 



( 64 ) 



E[bjk) bjk)] 




for m = n 
for m * n . 



( 65 ) 



A lattice predictor structure is commonly used to generate 
the backward errors. The lattice structure shown in Figure 
3.5 utilizes the backward errors in an adaptive filter. Let 
the transfer function needed to generate each {b^(k)} be 
denoted by 
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X{Z) 



( 66 ) 



By comparing Figure 3.5 to Figure 3.2 we note that A^(z) has 
a definite relationship to Q^^(z) . The exact relationship 
could be found by evaluating each A^(z) using the signal flow 
graph in Figure 3.5. Furthermore, it is apparent that 
Uj^(k) = b|^(k) , and, thus, the backward prediction-errors could 
be said to form a family of orthogonal polynomials. The 
synthesis of a linear system is accomplished by forming linear 
combinations of the backward prediction-error polynomials. 






Figure 3.5: Lattice predictor adaptive filter. 
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IV. SIMULATION RESULTS 



A. FIR BANDPASS FILTER SIMULATIONS 

For the purpose of evaluating the FIR system modeling 
performance of the orthogonal polynomials, two bandpass FIR 
filters were chosen as the systems to be identified. The FIR 
filters were designed for filter orders of 22 and 71, with 
cutoff frequencies of 0.1 and 0.2 (fraction of sampling 
frequency) . Each filter was excited by a zero-mean Gaussian 
white noise sequence with unit variance. The desired output 
sequence was compared against the output of the orthogonal 
network, and the error was used to update the expansion 
coefficients . 

Figure 4.1 shows the impulse and frequency response plots 
of an IS^*^ order Legendre adaptive digital filter (ADF) with 
C = 0.11 when used to model a 22^^*^ order FIR system. Notice 
that the Legendre filter has an infinite impulse response that 
allows smaller order Legendre filters to model larger order 
FIR systems. In this case an 18^^ order model is used for a 
22"*^ system, which is roughly an 18% savings in terms of the 
filter order. Figure 4.2 shows a 52"*^ order Legendre ADF model 
with C = 0.075 used to model a 71®^ order FIR system, which is 
approximately a 27% savings in terms of the filter order. 
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Figure 4.1: Impulse and frequency response of an 18^^ order 
Legendre ADF used to model a 22"° order FIR filter. 




Sample 




Figure 4.2: Impulse and frequency response of a 52"^^ order 

Legendre ADF used to model a 71^^ order FIR filter. 
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The convergence of the first six expansion coefficients 
for the 18^^ order Legendre ADF and the resulting filter output 
error are shown in Figure 4.3. Notice that all coefficients 
converge by the 200^^ sample, which implies we need an input 
sequence that has approximately 10 times more samples than the 
order of the system to be modeled. 




Sample 




Figure 4.3: (a) Convergence of first six expansion 
coefficients and (b) Output error for an 18^^^ order Legendre 
ADF used to model the 22"*^ order FIR system. 

The performance results when an 18^*^ order Laguerre ADF 
with C = 0.98 is used to model the 22"*^ order FIR system is 
shown in Figure 4.4. The fact that the results are comparable 
to the Legendre ADF is not surprising, for the transfer 
functions needed to generate both sets of polynomials have the 
same number of poles and zeros (see (40) and (60)). Likewise, 
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Figure 4.5 shows the result of a 52""^ order model with C = 0.98 
used to model the 71®^ order FIR system. 





Figure 4.4: Impulse and frequency response of an 18^" order 
Laguerre ADF used to model a 22'^*^ order FIR filter. 

We expect an improvement in performance when using the 
Jacobi ADF, for the transfer function needed to generate each 
Jacobi polynomial has more poles than that needed to generate 
the Legendre and Laguerre polynomials. Exactly how many more 
poles are realized depends on the value of a. In the case 
where a = 4.0, two more poles are realized in each transfer 
function that generates the corresponding Jacobi polynomial. 
Figure 4.6 shows the results of a 15^^ order Jacobi simulation 
with {C, a, 3} = {0.002, 4, 1000} when used to model the 22"^^ 
order FIR system. 
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Sample 




Figure 4.5: Impulse and frequency response of an 52"*^ order 

Laguerre ADF used to model a 71®^ order FIR filter. 




Figure 4.6: Impulse and frequency response of a 15^^ order 

Jacobi ADF used to model a 22"*^ order FIR filter. 
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Note that the frequency response of the Jacobi model is 
significantly better in the lower end of the spectrum than in 
the higher end. This can be attributed to the fact that the 
frequency response of each Jacobi polynomial has lowpass 
characteristics; therefore, it is not surprising that a linear 
combination of Jacobi polynomials would perform better when 
modeling frequencies in the lower end of the frequency 
spectrum. The same is true for both the Legendre and Laguerre 
polynomials. The 71*^ order FIR system was not modeled using 
the Jacobi polynomials due to the difficulties encountered in 
determining the transfer functions of the higher order Jacobi 
polynomials as discussed in part C of chapter III. 

Unlike the Legendre, Laguerre, and Jacobi filters, the 
lattice filter structure has a finite impulse response. The 
15^^ order Lattice model produces comparable results to that 
of the classical orthogonal polynomial models when used to 
model the 22^^^ order FIR system (see Figure 4.7). Although the 
lattice filter has a finite impulse response. Figure 4.8 shows 
that a 52'^'^ order lattice filter is able to effectively model 
a 71*^ order FIR system. 
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Figure 4.8: Impulse and frequency response of a 52"^ order 

lattice ADF used to model a 71®^ order FIR filter. 
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B. HR BANDPASS FILTER SIMULATIONS 



As with the FIR filters, two Butterworth HR bandpass 
’ filters were designed to evaluate the HR modeling performance 
of the orthogonal ADFs . The HR filters were designed for 
filter orders of 7 and 31, with cutoff frequencies of 0.1 and 
0.2. Since an order HR filter has 2N coefficients, our 
aim is to use orthogonal function adaptive models with 
approximately 2N coefficients. The results herein show the 
lowest order ADF models that demonstrated satisfactory 
performance . 

Figure 4.9 shows a 15^^ order Legendre ADF with C = 0.075 
used to model the 7^^ order Butterworth HR filter. Notice 
that the Legendre ADF does not model the low order HR system 
as well as the low order FIR system as shown in Figure 4.1. 
The HR filters are difficult to model because the structure 
of the orthogonal adaptive filters more closely resembles a 
FIR filter (see Figure 3.2). 

Figure 4.10 shows a 65^^ order Legendre ADF with C = 0.055 
used to model the 31®^ order HR filter. Notice that the 
impulse response of the HR filter is still significant beyond 
140 samples, but the impulse response of the ADF does a poor 
job of duplicating it. 

As in the FIR case, the Laguerre ADF performance is 
similar to that of the Legendre ADF. Figure 4.11 shows a 15^^ 
order Laguerre ADF with C = 0.98 modeling a 7^^ order HR 
filter. There is marked increase in performance when the 
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Figure 4.9: Impulse and frequency response of a 15^*^ order 

Legendre ADF used to model a 7^^ order HR filter. 





Figure 4.10; Impulse and frequency response of a 65^^ order 
Legendre ADF used to model a 31®^ order HR filter. 
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order of the system being identified is increased. 
Figure 4.12 shows that the order HR system can be modeled 
with a 65^^ order ADF. The Laguerre ADF has better performance 
characteristics than the Legendre ADF (see Figure 4.10) in 
both the passband and the stopband. 





Figure 4.11: Impulse and frequency response of a 15^^ order 

Laguerre ADF used to model a 7^^ order HR filter. 

A 15^^ order Jacobi adaptive filter with parameters 
{C,a,^} = {0.0015, 4.0, 925.0} was used to model the 7^^ order 
HR filter, and the plots of the model's impulse and frequency 
response are shown in Figure 4.13. It appears that the two 
additional poles in the Jacobi transfer functions do not 
significantly increase low order modeling performance when 
compared to the Legendre and Laguerre polynomials. However, 
there is a possibility that other parameter sets, {C, a, (3}, 
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Impulse Response: Desired Versus Laguerre ADF 




Figure 4.12: Impulse and frequency response of a 65^^ order 

Laguerre ADF used to model a 31®^ order HR filter. 




Figure 4.13: Impulse and frequency response of a 15^^ order 

Jacobi ADF used to model a 7^^ order HR filter. 
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do exist that would produce better results. 

The 15^^ order lattice ADF simulation of the 7^^ order HR 
filter is shown in Figure 4.14. As with the FIR case, the 
lattice filter performs better when modeling smaller order 
systems. Notice the poor performance of the 65^^ order lattice 
ADF when modeling the 31^^ order HR filter as shown in 
Figure 4.15. The reason the lattice filter performs worse 




Figure 4.14: Impulse and frequency response of a 15^^ order 
lattice ADF used to model a 7^^ order HR filter. 

than the classical orthogonal polynomial filters is that it 
has a finite impulse response, which restricts it ability to 
model higher order HR systems. 
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Magnitude (dB) Amplitude 





Figure 4.15: Impulse and frequency response of a 65^^ order 

lattice ADF used to model a 31®^ order HR filter. 
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V. CONCLUSIONS 



There are several characteristics of orthogonal filter 
models that make their use attractive. The classical 
orthogonal function filters are particularly adept at modeling 
systems with long impulse responses. FIR systems with large 
orders (say, greater than 70) can generally be modeled with 
25-30% fewer coefficients using the orthogonal ADFs. Large 
order HR systems can commonly be modeled with the same number 
of coefficients that are in the HR system. The research in 
this thesis has only evaluated the performance of the 
orthogonal ADF models when used to identify bandpass FIR and 
HR filters. It is quite possible that systems with strictly 
lowpass or highpass characteristics could be modeled with 
varying degrees of success. Although the orthogonal function 
filter models have shown considerable promise, there are 
several limitations that must be addressed; recommendations 
for future research are also presented. 

A. LIMITATIONS OF ORTHOGONAL FILTER MODEL 

Previous research has shown that the convergence rate for 
the LMS expansion coefficients is increased when using 
orthogonal functions [Ref. 1]. Even so, the length of the 
input sequence must be increased when the desired filter order 
is increased in order to allow the expansion coefficients 
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sufficient time to converge. Typically, the input sequence 
must have a length that is 10 to 15 times greater than the 
desired model order. This fact places limitations on the 
orthogonal function models, for large order models require 
long input sequences. 

The selection of the positive real constant, C, will 
significantly influence the performance of the Legendre, 
Laguerre, and Jacobi adaptive filters. Furthermore, the 
Jacobi polynomials have two additional parameters, a and 3/ 
that must be chosen for any given simulation. There is 
currently no known algorithm for optimizing the selection of 
these parameters. Therefore, evaluating the performance of 
the orthogonal function filters is largely a matter of trial 
and error. 

The theory for the classical orthogonal function filters 
was derived in the continuous time and frequency domains. The 
matched Z-transform technique was used to map the poles and 
zeros of the orthogonal filters from the s-domain to the z- 
domain. Unfortunately, the matched z-transform technique was 
found to introduce errors concerning the orthogonality of the 
filter output sequences. Other analog to digital 
transformations appear no more attractive, for their use would 
eliminate the ability to express the filter transfer functions 
in a closed form. 
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B. RECOMMENDATIONS FOR FURTHER RESEARCH 



An algorithm to determine the selection of the positive 
real constant, C, is needed to reduce the trail and error 
nature of the classical orthogonal filter models. Further 
exploration of the Jacobi polynomials is bound to yield 
improved results, for little is known concerning the effect of 
altering a and 3. The application of orthogonal filter models 
to a broad range of systems should be explored. Because the 
classical orthogonal polynomials are lowpass in nature, their 
application may be limited. 
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